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Executive Summary 



Individual Education Plans (IEP’s) and 504 Plans often recommend the use of accommodations 
to facilitate the learning of classroom material by students with disabilities. Since the Individuals 
with Disabilities Education Act (IDEA) in 1997, students with disabilities are expected to par- 
ticipate in state and district-wide assessments, using appropriate accommodations. Large-scale 
assessment assumes the use of standardized testing conditions to allow for comparability of test 
scores; however, some students with disabilities are better able to demonstrate their knowledge 
when allowed to use accommodations that offset the effect of their disability on the construct 
tested. For these students, de-standardizing the test conditions is the only meaningful way to 
obtain an accurate estimate of achievement. 

In 1999 the Special Education Elementary Longitudinal Study (SEELS) began to examine the 
experience of elementary age students in schools, and pertinent to this report, their experience 
in testing situations, particularly the use of accommodations. In this paper, using data from 
SEELS, we examine accommodation use across different educational conditions, comparing 
IEP and 504 Plan accommodations to what students reportedly received in the classroom and 
on standardized tests. 

Results suggest a lack of alignment in accommodation use among IEP/504 plans, classroom 
conditions, and state testing situations. Additionally, there is some variability in what happens 
for students with different categorical labels. Since the data for this report was obtained from 
an early administration of the SEELS (Wave 2), monitoring of the alignment issue should 
continue. 
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Introduction 



With increasing importance placed on including students with disabilities in large-scale as- 
sessment, psychometricians, researchers, and policymakers are pressed to understand who is 
receiving accommodations, what accommodations are provided, whether there is consistency in 
accommodation use across educational settings, and how accommodations impact test scores. 
In 1999 the Special Education Elementary Longitudinal Study (SEELS) began a 6-year study 
of elementary age students that will help to answer some of these questions as well as others 
related to the experiences of students with disabilities. 

One of several areas that SEELS researchers have begun examining is accommodation and 
support, as used by students with disabilities in language arts classes. Comparisons have been 
made across disability categories, general and special education classrooms, and several ad- 
ditional student demographic characteristics. In a similar national longitudinal study on the 
experiences of middle and high school students, National Longitudinal Transition Study-2 
(NLTS2) researchers examined the frequency with which different accommodations were used 
on standardized tests, comparing disability categories, race/ethnicity, and income (http://www. 
nits 2 . org/index . html) . 

Both the SEELS and NLTS2 studies were commissioned following the reauthorization of the 
Individuals with Disabilities Education Act (IDEA) in 1997, which for the first time in special 
education law confirmed that students with disabilities were to participate in state and district- 
wide assessments, with accommodations where appropriate. This dramatic change in special 
education federal law in 1997 promoted the need for the SEELS and NLTS2 studies, which to 
some extent because of their timing would both reflect and be caught up in the changes that 
were sure to occur over time. 

Similar to previous SEELS and NLTS2 reports on accommodation, the goal of this report is to 
examine accommodation use during the elementary and middle school years. Unlike previous 
reports, we examine accommodation use across different educational conditions, comparing 
IEP and 504 Plan accommodations to what students reportedly received in the classroom and 
on standardized tests. In doing this, we hope to gain a better understanding of the consistency 
with which accommodations are provided. This report is a preliminary analysis based on SEELS 
data available at http://www.seels.net/. 

Background 

The value of implementing large-scale assessment under standardized conditions is in the com- 
parability of test scores. If all else is held constant, score differences can be attributed to differ- 
ences in learning achievement (Salvia &Ysseldyke, 2001). As Salvia andYsseldyke recognize, 
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however, the process of standardization can prevent the accurate measurement of achievement 
for students with disabilities. In order to accurately measure achievement, such students need 
accommodations that offset the effect of the disability on their ability to demonstrate knowledge 
(McDonnell, McLaughlin, & Morison, 1997 ; Rose, 2000). In other words, in some circumstances 
the only way to obtain a meaningful estimate of achievement is to de-standardize the testing 
process (e.g., providing enlarged print for a student with a visual impairment, or providing a 
reader for a student with a reading disability; Phillips, 1994). 

Research suggests that when some accommodations are provided consistently in both the 
original learning environment and the testing process, these accommodations have a greater 
impact on student assessment performance. For example, Russell (1999) compared the impact 
of handwritten responses to typed responses on standardized test scores. Results suggested that 
students performed better when they were allowed to record answers in the format in which 
they learned and practiced the skills and knowledge. That is, students who were accustomed to 
writing on computers tended to generate higher quality responses on open-ended test items when 
allowed to use computers than students less accustomed to writing on a computer. Similarly, 
students who were not as computer proficient performed better on open-ended standardized 
test questions when allowed to handwrite answers than students more accustomed to writing 
on computers. Although Russell was not studying students with disabilities, the results support 
the need to match accommodations used in testing to accommodations typically available to 
students in class in order to maximize students’ ability to demonstrate learning achievement. 
(Sireci, Scarpati, & Li, 2005). 

Why This Report? 

Given the high stakes associated with tests for both students and schools, and given research sug- 
gesting that students perform better when provided similar accommodations in both classroom 
learning and testing situations, we need to understand what is occurring in classrooms and on 
assessments, beyond looking at state policy guidelines and reports. In addition to observations, 
an effective way of determining what accommodations are available to students with disabilities 
is to ask teachers and school personnel to report on student IEP/504 Plans and accommodation 
use in classrooms and on standardized tests. 

This preliminary report compares the reported proportions of IEP/504 Plan accommodations 
with the proportions of accommodations used in class and in standardized testing conditions. 
The purpose is to explore proportional consistency across conditions. Additionally, we compare 
the use of various accommodations across four of the most common disability categories. As- 
sessment accommodation policies influence the accommodations that may or may not be used 
and how scores are counted; nevertheless, a general understanding of how accommodation 
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practices vary across students with differing disabilities will facilitate student participation in 
education in a fair and appropriate manner. 



Data Source and Methods 

The data for this report are from the Special Education Elementary Longitudinal Study (SEELS), 
a national study conducted by SRI International and Westat for the U.S. Department of Educa- 
tion. The purpose of the SEELS study is to document “the educational experiences and prog- 
ress of thousands of elementary and middle school students nationwide who received special 
education services in 1999” (p. 1). To obtain a more comprehensive picture of the experiences 
of participants, information is being collected over a 6-year period from parents, teachers, and 
students (SEELS Newsletter, 2003). This information pertains to a variety of experiences stu- 
dents with disabilities have, ranging from academic performance and school experiences, to 
family supports, social adjustment, and personal growth. Information is being collected in three 
waves. Our review is limited to 2001-2002, Wave 2 information available on the SEELS Web 
site pertaining to accommodations as required or recommended on student IEP/504 Plans and 
their reported use in language arts classes and on standardized tests. 

SEELS Sample. The SEELS sample consists of 11,512 students receiving special education 
in at least one grade from first to seventh grades. The representative sample was selected from 
245 LEAs and 32 special schools across the country so that statistical summaries from SEELS 
will “generalize to special education students nationally as a group, to each of the 13 federal 
special education disability categories, and to each single-year age cohort” (http://www.seels. 
net/studydesign.htm). 

SEELS Data Collection Instruments. SEELS researchers collect information about students 
repeatedly as they progress from elementary to middle school and from middle school to high 
school. Sources include: (1) a parent/guardian interview; (2) a Teacher Survey; (3) School 
Program Survey; (4) School Characteristics Survey; (5) transcripts; and (6) direct assessments 
of students’ reading and math skills, self concept and attitudes about school. 

Selection of SEELS Data on Accommodations for This Report. We were most interested in 
three specific uses of accommodations, that is, what accommodations were stated on students’ 
IEP/504 Plans, what accommodations were used in classrooms, and what were used on stan- 
dardized tests. Accordingly, although all four of the above listed questionnaires have questions 
pertaining to accommodations, we chose as our data source the two that were completed by 
people most likely to know what the student was receiving on a daily basis and to have direct 
access to the student’s IEP/504 Plan. These questionnaires are the Teacher Survey, which was 
completed by the student’s language arts teacher and the School Program Survey, which was 
completed by the school person who knows the student’s programs well. 
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In terms of selecting the accommodations of interest for this report, we noted some discrepancies 
in the wording of items on the data sources (e.g., the terms “modification” and “accommodation” 
are used interchangeably, making it unclear how respondents may have interpreted the questions). 
This interchange of terms is consistent with the terminology in IDEA 97, which was changed 
in IDEA 2004 because the field did not actually use the terms accommodation and modification 
interchangeably. Specific accommodations were selected to include in the report either because, 
as a response choice, they were similar across conditions (IEP, language arts class, and standard- 
ized testing) or a similarly worded response choice was available under the three conditions. 
These included: extended time, read aloud, setting accommodations, response accommodations, 
modified test, and alternative/alternate tests. Accommodations focused only on the classroom 
are not discussed (e.g., slower-paced instruction, shorter/different assignments). 

Another discrepancy was the use of the words “alternate” and “alternative.” Survey instruments 
used the term “alternate tests or assessments”, but data tables referred to “alternative assess- 
ments.” The word “alternative” was also used with other nouns such as “alternative settings.” 
We use “alternate” in this report to refer to alternate assessments. 

Selection of Student Groups to Compare. SEELS data tables present results for twelve dis- 
ability categories. In this report we describe the accommodations/modifications recommended 
and used by the four most prevalent disability categories. These groups represent approximately 
90% of all students with disabilities (U.S. Department of Education, 2002). These categories 
include learning disability (LD), speech/language impairment (SI), mental retardation (MR), and 
emotional disturbance (ED). To view disaggregated information for less frequently appearing 
disabilities or additional information about the study, go to the SEELS Web site at http://www. 
seels.net/. 

Definitions. For the purposes of this report, the following definitions were used: 

Accommodations are “those alterations to test presentation, setting, timing, scheduling, and re- 
sponse that mitigate the barrier of disability and allow a student with disabilities to demonstrate 
actual achievement in a particular academic area without changing the underlying construct of 
what is being measured” (Shaftel, Yang, Glasnapp, & Poggio, 2005, p. 358). It follows that 
test accommodations “enable students to participate in state or district assessments in a way 
that assess abilities rather than disabilities” (Lehr & Thurlow, 2003, p. 2). 

The Standards (AERA, 1999) define a test modification as “changes made in the content, format, 
and/or administration procedure of a test in order to accommodate test takers who are unable 
to take the test under standard test conditions” (p. 183). For the purposes of some statewide 
testing programs, a distinction is usually made between accommodation and modification in 
that an accommodation does not alter the construct measured, while a modification is a change 
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that alters the construct (Sireci, Scarpati, & Li, 2005). In the SEELS data such a distinction is 
not made and the words are used interchangeably. 

a) Extended time — “Increase the allowable length of time to complete a test or assignment 
(and/or). . . change the way the time is organized” (Cordelia, 2005, p. 3) 

b) Read aloud — is a presentation accommodation, which “allow students to access infor- 
mation in ways that do not require them to visually read standard print. These alternate 
modes of access are auditory, multi- sensory, tactile, and visual” (Cordelia, 2005, p.3). 

c) Setting — “Change the location in which a test or assignment is given or the conditions of 
the assessment setting” (Cordelia, 2005, p.3). 

d) Response — “Allow students to complete activities, assignments, and tests in different 
ways to solve or organize problems using some type of assistive device or organizer” 
(Cordelia, 2005, p. 3). 

e) Other — “Special test preparation, on task/focusing prompts, and others that do not bt into 
other categories” (Thurlow, Elliott, & Ysseldyke, 2003, p. 31). 

Alternate assessments. Alternate assessments are tools used to evaluate the performance of 
students who are unable to participate in general state assessments even with accommodations 
(Thurlow, Elliott, & Ysseldyke, 2003). 

Organization of the findings. In what follows we first present the overall comparison of accom- 
modations as stated on IEP/504 Plans, as used in the classroom, and as used for standardized 
tests. We then show differences in accommodation by disability type. Each section is followed 
by a short discussion. This same presentation format continues for modified test and alternate 
test. Finally we consider the findings and their implications as a whole. 

Findings 

Extended Time 

Extended Time by Condition. Differences across conditions existed in the relative propor- 
tion of students receiving extended time (see Figure 1). Although 76.2% of students had this 
accommodation stated on IEP/504 Plans, and 75.6% were reported to have received additional 
time taking tests in language arts classes, only 53.3% received this accommodation on stan- 
dardized tests. 

Extended Time by Disability Group. The proportional use of extended time varied somewhat 
across disability categories and condition. Figure 2 shows that of the four disability categories, 
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Figure 1. Extended Time: Disabilities Combined 



Extended Time 



Standardized tests 



£ 

0 

V 

‘g In-class 

£ 

0 

u 



IE P/504 



0 20 40 60 80 100 

Percent of Students 

* Standard error of measurement (SEM): IEP/504 Plan (IEP/504) = 1.6 (n = 4,933), Language Arts Class (Class) 
= 1.5 (n = 5,243), Standardized Tests (Test) = 2.1 (n = 3,241). 











3 








53. 












T. 


.6 


















5.2 















Figure 2. Extended Time: Separated by Disability 
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* SEM - LD: IEP/504 = 2.3 (n = 557), Class = 2.2 (n = 605), Test = 3.3 (n = 458); MR: IEP/504 = 2.7 (n = 550), 
Class = 2.8 (n = 573), Test = 3.7 (n = 286); SI: IEP/504 = 4.7 (n = 202), Class = 4.3 (n = 274), Test = 4.3 (n = 
238); ED: IEP/504 = 2.8 (n = 448), Class = 3.1 (n = 470), Test = 3.8 (n = 343). 
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only the percentage of students with mental retardation using extended time across conditions 
tended to appear equivalent (MR: IEP/504 = 71.0%, Class = 71.2%, Tests = 71.5%), There was 
more variability for other disability groups. Students with emotional disturbance and learning 
disability tended to have congruence between the IEP/504 plan and use of the accommodation 
in language arts classes, with less use of the accommodation in the standardized testing con- 
dition. The greatest disparity occurred for students with a speech/language impairment (LD: 
IEP/504 = 83.5%, Class = 85.0%, Test = 58.1%; SI: IEP/504 = 66.4%, Class = 61.2%, Test = 
35.2%; ED: IEP/504 = 78.4%, Class = 78.5%, Test = 59.9%). These students were least likely 
to receive extended time in any condition. 

Extended Time Discussion. The provision of additional time is one of the most frequently used 
accommodations for assessments (Sireci, Li, & Scarpati, 2003). In a review of research on time 
accommodations, Sireci et al. (2003) found evidence suggesting that students with disabilities 
tend to benefit more from extended time than students without disabilities. Sireci, Scarpati, and 
Li (2005) analyzed test accommodations in terms of the interaction hypothesis, which postulates 
that an accommodation does not threaten the validity of test scores if the use of it improves 
the performance of students with disabilities but does not improve the performance of students 
without disabilities. These researchers found that extended time improves the performance for 
all students but that students with disabilities experience greater gains. 

The impact of extended time on the validity of interpretations of test scores is not well under- 
stood. Although predictive validity appears to be reduced when timing accommodations are 
used on the SAT, the population (i.e., college bound, high school students) is not representative 
of typical K-12 students who require accommodations, nor is there a comparable criterion to 
college GPA (Sireci, Li, & Scarpati, 2003). Considering that 76.2% of students with disabilities 
had extended time on their IEP/504 Plan, and over half of the students taking the standardized 
test (53.3%) were reported as having received it, better understanding of the effects of this ac- 
commodation on test scores is warranted. 

Read Aloud 

Read Aloud by Condition. The percentage of students provided a read aloud accommodation, 
both in class and as stated on IEP/504 Plans, was somewhat greater than the percentage of 
students who received a read aloud accommodation on standardized tests (IEP/504 = 50.0%, 
Class = 51.5%, Test = 40.6%). 

Read Aloud by Disability Group. The proportion of the read aloud accommodation varied 
somewhat across disability categories (see Figure 4). Overall, students with mental retardation 
were most likely to receive this accommodation and to receive it consistently across conditions 
(MR: IEP/504 = 60.7%; Class = 60.9%; Test = 68.1%). Students with speech/language impair- 
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